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Abstract. We consider the problem of multiple description scalar quantizers and describing the achievable 
rate-distortion tuples in that setting. We formulate it as a combinatorial optimization problem of arranging 
numbers in a matrix to minimize the maximum difference between the largest and the smallest number in 
any row or column. We develop a technique for deriving lower bounds on the distortion at given channel 
rates. The approach is constructive, thus allowing an algorithm that gives a closely matching upper bound. 
For the case of two communication channels with equal rates, the bounds coincide, thus giving the precise 
lowest achievable distortion at fixed rates. The bounds are within a small constant for higher number of 
channels. To the best of our knowledge, this is the first result concerning systems with more than two 
communication channels. 
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1 Introduction. 

Consider sending information over k independent unreliable channels. We want to partition the source 
information into k subsets so that if all k subsets are received, the original information can be completely 
reconstructed, and if any of the channels fail, then the error, defined as the absolute (rather than Hamming) 
difference between the original information and the possible reconstruction of it, is minimized. Figure [l] 
shows the general setting of the problem. A trivial solution would be to divide the source information into 
k equal blocks, sending each over a separate channel; however, if any block fails to arrive, that part of the 
information is lost completely. The error in this case could strongly depend on which channel was lost, a 
feature we would like to avoid. Alternatively, we could send k complete copies, so that even if only one of 
the channels succeeds, all the information is still available; however, while the scheme is robust it utilizes 
the resources poorly. Our goal is to partition the information in a way that allows us to recover as closely 
as possible the information originally sent, the error depending on the number of channels lost, regardless of 
which channels failed. 



1.1 Background 

The problem of designing codes for a diversity-based (multichannel) communication system, that guarantee 
a minimum fidelity at the user end, based on the number of channels succeeding in transmitting information, 
is known as the Multiple Descriptions problem. It was introduced by Gersho, Witsenhausen, Wolf, Wyner, 
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Figure 1: Schematic setting of the multichannel problem. 



Ziv, and Ozarow at the 1979 IEEE Information Theory Workshop. It is a generalization of the classical 
problem of source coding subject to a fidelity criterion p4| . 

Initial progress on the Multiple Descriptions problem was made by El-Gamal and Cover |jj , who studied 
the the achievable rate region for a memoryless and a single-letter fidelity criterion. Ozarow |23| showed 
that the achievable region derived in J8| is the rate-distortion region for the special case of a memoryless 
Gaussian source and a square-error distortion criterion. Zhang and Berger p3[ ] and Witsenhausen, Wolf, 
Wyner, and Ziv pC| . pl| explored whether the achievable rate region is the rate-distortion region for other 
types of information sources. 

The first constructive results for two channels with equal rates were presented by Vaishampayan [f?6| , 
fjEf . In 1 26 Vaishampayan designs Multiple Descriptions Scalar Quantizers (MSDQs) with good asymptotic 
properties. We show, however, that this solution is not optimal. 

An MSDQ is a scalar quantizer (mapping of the source to a finite integer point set) that is designed to 
work in a diversity-based communication system. The problem of designing an MSDQ consists of two main 
components: constructing an index assignment, which is a mapping of an integer source to a tuple to be 
transmitted over the channels, and optimizing the structure of the quantizer for that assignment. This paper 
focuses on the index assignment problem. We present a general technique for designing index assignments for 
any number of channels with arbitrary rates. We give upper and lower bounds for the information distortion 
for fixed channel rates. In case of two channels transmitting at equal rates, the bounds coincide, thus giving 
an optimal algorithm for the index assignment problem. In the case of three or more equal-rate channels, 
the bounds are within a multiplicative constant. 

Real applications of the index assignment problem arise in video and speech communication over packet- 
switched networks, where the information has to be split into several packets which can be lost in transmission 
resulting in poor signal quality (@, @, |§, @). 



1.2 Problem Statement 

We are given a communication system with k channels. Channel i transmits information reliably at rate 
logrii bits per second. Each channel either succeeds or fails to transmit the information. If a channel fails, 
all the information transmitted over the channel is lost. If a channel succeeds, the received information is 
assumed to be correct. 

We assume the source to generate integers with uniform distribution, the result of a quantization process. 
It is unimportant what the numbers actually are, and we refer to them by the indices through m — 1 for 
some m. Thus we consider the information to be transmitted to be an integer x with at most lgm bits, where 
1 < to < 77i 772 • • -Tifc. An (tii, 772, ) -level MSDQ maps i to a unique fc-tuple ...,ik)', component ij 
is sent over the jth channel. If all of the channels succeed, then we want to be able to decode x from the 
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Figure 2: Correspondence be- 
tween an encoding scheme 
and arrangement of numbers 
in a matrix. 



Figure 3: Examples of encoding schemes and the corresponding ma- 
trices: left - identical copies of the input number are sent over the 
channels; right - the input number is split into blocks of bits, which 
are sent over the channels. 



fc-tuplc exactly. If some of the channels fail, we want the encoding to minimize the distortion between the 
original information and the reconstructed transmission. The system can be viewed as one encoder 

/ : {0,..,m-l}^{0,...,m-l} x ■■• x {0,...,n fc - 1} 

and 2 k — 1 decoders, (go, ■ ■ ■ , <72 fc — 2) j each dealing with a unique subset of successful channels, with at least 
one succeeding channel. Let go be the decoder with all channels succeeding. The problem we are interested 
is describing the rate-distortion tuples 

(logni,logn 2j ...,logra fe ;0, D 1 , ...,D 2 k_ 2 ), 

where D t is the distortion rate of the set of channels represented binary by t, a 1 corresponding to failure. 
This is a generalization of the notation used for two channels, where the rate distortion tuples are specified 
by (Ri, R 2 ; Do, Di,D%). Here Ri and R 2 are the transmission rates of the two channels, Do is the distortion 
in case both channels succeed, D± is the distortion in case of the first channel failure, and D 2 is the distortion 
in case of the second channel failure. 

Consider the available information in case of channel failure. If some of the channels fail, the remaining 
successful channels imply upper and lower bounds on x, namely the largest and the smallest values among 
those consistent with the successful components of x. For example, when k — 2, x is mapped to a pair 
(ii,ia)- If the first channel fails, we know x is between the smallest and the largest numbers having second 
component i 2 , while if the second channel fails, x is between the smallest and the largest numbers having 
first component i\. Thus, designing a code to minimize distortion in case of any I channels failing in a 
system with source dictionary of size m and k channels, channel i transmitting reliably at rate logrij, is 
equivalent to the combinatorial problem of putting numbers X = {0, m — 1} into a fc-dimensional matrix, 
dimension i being of size rij, to minimize the difference between the smallest and the largest number in each 
full ^-dimensional submatrix. This correspondence is shown in Figures and [}| In this paper we will be 
working with the combinatorial version of the problem. 

The problem is also equivalent to minimizing graph bandwidth of a /c-fold cartesian product of cliques 
(Hamming graph) and induced subgraphs of it. There is a large body of research dedicated to the band- 
width of various graphs. There are two possible simplifications of the Hamming graph bandwidth problem: 
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either small cliques, or few cliques. In 1966 Harper jl4| solved the bandwidth problem for a fc-dimensional 
hypercube, the cartesian product of fc cliques of size 2. Hendrich and Stiebitz solved the problem for 
cartesian product of two cliques of equal size. We propose a vertex labeling of the cartesian product of an 
arbitrary number of cliques of arbitrary (equal) size. To the best of our knowledge, result gives the best 
upper bound on the bandwidth of products of more than two cliques of size greater than 2. 

For a survey on the topic of graph bandwidth up to 1982, see Q|. For a recent survey on Harper-type 
techniques on graphs see [Q. For more information on the subject of graph bandwidth see West, pjfl . 

1.3 Notation and Terminology 

• Arrangement - the inverse of encoding, that is a function from the cells of the matrix to the numbers 
to be put in those cells: 

A: J-{l,...,m}, 
where / is a subset of the product of the sets of indices It X • • • X Ik ■ 

• Slice - a full submatrix. An Z-dimensional slice is a subset of all cells with fc — I coordinates fixed: 

(*,...,*, *,...,*, ij 2 , *,...,*, ij k _, )*,•••, *)• 

• Line - a one-dimensional slice: 

(ii,i2, *, .-.,ifc). 

• Spread - the difference between the largest and the smallest number in a slice. 

• Maximum spread of an arrangement, spread(A) , - the maximum over all the spreads in slices of the 
same fixed dimension. 

• Smalls - a plural form of "the smallest number" , a set of the smallest numbers in a set of slices. 

• Bigs - similar to smalls, a plural form of "the largest number" . 



2 Results 

We design a technique that provides a lower bound on the maximum spread in a line in any arrangement of 
the numbers X = {0, ...,m — 1} in a fc-dimensional matrix. The technique is constructive, which allows us 
to design an algorithm that gives an upper bound. 

First, we consider the case of equal channel capacities, so that the corresponding fc-dimensional matrix 



is a cube. We discuss the unequal channel capacities in Section 2.5. In addition, the lower bound and the 
algorithm are derived for the case of only one channel failing. In Section |2.2| we show the results for an 
arbitrary number of channels failing. The fc-channel problem thus reduces to finding an arrangement of the 
m numbers in an n x • • ■ x n fc-dimensional matrix that minimizes the maximum spread in a line. 
The idea of the lower bound proof is as follows: 

1. For any possible arrangement A of X = {0, ...m — 1} in the matrix, consider the sorted (in ascending 
order) list of smalls in all lines, small(A). If a number is the smallest one in more than one line, than it 
appears in this list more than once. For example, always appears fc times and any small(A) list starts 
with fc zeros. The goal is to find a bounding sequence of smalls that is at least as large elementwise 
as any such smalls list. Then the jth smallest number in a line in any arrangement, small(A)j, is at 
most the jth member of the bounding sequence. Let (a) = (at, a-x, ...) be the bounding sequence; then 
the following must hold for all j: 

a,j = max{small(A)j}. 

We will show in Lemma |^ that there exists an arrangement whose smalls list realizes the bounding 
sequence. 
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Figure 4: The process of derivation of the lower bound on spread. 



2. Similar to the smalls, find a bounding sequence of bigs that is elementwise at most any bigs list, big (A), 
produced by any arrangement. Let (b) = (b±, 62, ■■■) be the bounding bigs sequence; then the following 
must hold for all j : 

bj = jmn{big(A)j}. 

Lemma [2] shows that there exists an arrangement whose bigs list realizes the bounding sequence. 

3. Maximum pairwisc difference of the bigs and smalls lists of an arrangement is a lower bound on the 
maximum spread of the arrangement, spread(A) . That is, for all A 

m&x{big(A)j — small(A)j} < spread(A) . 
j 

This statement is known as the Ski Instructor problem and the proof can be found in |2lJ . 

Since for the bounding sequences (b) and (a) we have bj < big{A)j and aj > small(A)j for all A and j, 
then pairing smaller bj with smaller aj gives a lower bound on the spread for all possible arrangements. 
For all A: 

max(&j — aj) < max{big(A)j — small(A)j} < spread(A) . 

j j 

The process is shown schematically in Figure |j. 

Thus, the main focus of our proof is finding good bounding sequences. Consider the smalls sequence. 
Suppose we have an initial segment of the bounding smalls sequence, (a%, 02, Oj), and are now concerned 
with the next element in that sequence. As we place the elements of X in increasing order into the cells, 
the key observation to maximizing the smalls sequence is that if x is a value in some cell (which can be 
thought of as the intersection of k lines), then x is the smallest number in every line that does not already 
have an element smaller than x. For example, if we put x into a cell that is an intersection of lines that do 
not currently have any elements in them, then x is the smallest number in k lines, and thus appears in the 
smalls sequence k times. On the other hand, if all k lines already have numbers less than x, then it does 
not appear in the smalls sequence at all, and the next candidate for the sequence member is at least x + 1. 
In general, if s out of k lines have elements less than x, then x appears in the smalls sequence exactly k — s 
times. Therefore, to maximize the next element of the smalls sequence we want to put x into a cell that 
is an intersection of as many as possible lines that already have elements lass than x. Given a choice, we 
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Figure 5: Let X\ and X2 be the elements less than x that already have been placed. All cells marked * are 
intersections of two lines, one of which already has a number smaller than x. However putting x in the cell 
below x\ or X2 will produce one cell that is an intersection of two lines, both of which have a smaller number. 
Thus we favor those over the cell to the right of X2, since placing x there results only in cells with at most 
one smaller number in their intersection. 

would also like to put 1 in a cell that reduces the number of lines without smaller values for the subsequent 
elements. An example of such placement is shown in Figure |. We now demonstrate the lower bound proof 
on some special cases. 

2.1 The Completely Filled Cube 

Assume that the matrix is cube, so rij = n for all i and the number of elements to be placed in the matrix is 
m = n k . This corresponds to all channels capacities being equal and the numbers to be transmitted over the 
channels have number of bits up to the sum of the number of bits that can be transmitted over each channel. 
This is the most commonly used setup in practice, especially in the context of packet switched network. From 
the rate-distortion point of view, this corresponds to tuples of type (logn,logn, logn; 0, D±, ...,Z? 2 fc -i)- 

First we show that for a completely filled matrix, it is sufficient to restrict our attention to a special kind 
of arrangements. 

Definition 1. Extending the definition in J7^/, an arrangement A is monotonic if for for any line 
(h, *, ...,ik) if V > 1 then 

A(h, ...,p, ...,ik) > A{h, ...,q, ...,i k ). 

Lemma 1. The maximum spread in a completely filled cube is minimized by a monotonic arrangement. 

Proof. We first show that given any arrangement completely filling the matrix, rearranging the numbers 
to become monotonic in one coordinate does not increase the overall spread. It is obvious that rearranging the 
numbers in any way within the same line does not change the spread in that line, thus the rearrangement for 
full monotonicity within a coordinate does not change the spread in that coordinate. Suppose the spread has 
increased for some coordinate. The situation is described in Figure ^. Suppose after the rearrangement the 
maximum spread in that coordinate is in line j and is dt — c s (where dt was in line t before the rearrangement, 
and c s was in line s). Then 

d t — c t < d t — c s , thus d s < d t , and 

d s -c s <d t - c s , thus c s < c t . 

Then there are j — 2 (since dt and c s are now in line j) d's less than dt and not equal to d s . There are j — 1 
c's less than c s and not equal to Ct- Therefore, by Pigeonhole Principle, there exists c p < c s that was paired 
up with dp > dt before the rearrangement. But then d p — c p > dt — c s . 

We have proved that rearranging the numbers in one coordinate line after line does not increase the 
spread in the matrix. Gale and Karp | fi"l| show that if the arrangement was monotonic in one coordinate 
then it will remain so after the number are rearranged to become monotonic in another coordinate. Thus 
the matrix can be rearranged to have a fully monotonic arrangement one coordinate at a a time, one line at 
a time, without increasing the spread. □ 

Thus, it is sufficient to consider only monotonic arrangements. 
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Figure 6: Rearrangement in one coordinate causes the spread in another coordinate to become dt — c s . 
Shaded are the c's less than c s but not equal to Ct and d's that are less than d t and not equal to d s . 

We can now define the arrangement that produces a bounding smalls sequence for the cubic matrix. In 
fact, this arrangement produces a bounding smalls sequence for a more general class of completely filled 
rectangular matrices, cube being a special case. 

Definition 2. A herringbone arrangement of a fc-dimensional n\ x «2 X • • • x completely filled matrix 
is defined inductively as follows. Assign an arbitrary order to the coordinates of the system ik)- A 

herringbone arrangement of x • • • x fc-dimensional matrix is empty. A herringbone arrangement of a 0- 
dimensional matrix is the number placed in a single cell. Given a herringbone arrangement of f i x £ 2 x ■ ■ ■ x tk 
fc-dimensional matrix (that is the cells of the matrix are filled up to the coordinate £j — 1 in dimension i), 
we define a larger herringbone arrangement inductively: 

• project the existing arrangement onto the (fc — l)-dimensional slices adjacent to the existing arrange- 
ment, 

• calculate the (fc — l)-dimensional volume of each projection, 

• recursively fill the largest volume projection (using coordinate order to break ties) with the herringbone 
arrangement for fc — 1 dimensions. 

Examples of 2 and 3-dimensional arrangements are shown in Figure @. The name "herringbone arrange- 
ment" is due to the herringbone-like pattern seen clearly in two dimensions. We denote the element in the 
cell (ii, ...,ifc) of the fc-dimensional herringbone arrangement by HBk{i\ 1 ...,?&). Let i max — i p . If there is 
more than one coordinate with the maximum value, take the largest coordinate. Then 

HBkih, ...,i k ) = {i p + ljfr- 1 ) • + HB^ih, ...,i p .x,i p+1 , ...,i k ). 

The last equality follows from the recursive definition of the herringbone arrangement. The herringbone 
arrangement fills the matrix in layers, the maximum coordinate value indicates which layer of the arrangement 
a cell is in. Thus the value in a cell is in the i p 'th layer, the first i p — 1 layers being completely filled and 
the element is within a (fc — l)-dimensional submatrix, recursively filled with the herringbone arrangement. 

Lemma 2. The herringbone arrangement of values in a k-dimensional matrix maximizes the smalls 
sequence - the ascending list of lines ' smallest numbers - for that matrix. 

Proof. The proof is a generalization of Harper's proof of the main theorem in [ p^[ . We use induction on 
fc and the largest dimension size, n max = max^n^}. 

The base cases of fc = and n rnax = 1 are trivial. 
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1+1 

Figure 7: An example of herringbone arrangements in 2 and 3-dimensional matrices. 

Suppose we have a matrix with the largest dimension size n ma x (largest coordinate value n ma x — !)• By 
the induction hypothesis, the herringbone arrangement maximizes the smalls sequence in the fc-dimensional 
matrix up to the coordinate value n max — 2 in every dimension, that is, it maximizes the initial segment of 
the smalls sequence for the entire matrix. 

Consider the smallest element x which has not yet been used in the arrangement. As we have noted 
before, every cell in the matrix is an intersection of k lines. We shall call a line protected if it has a smallest 
number in it. Since we are placing numbers in the increasing order, this means a line is protected if it has 
any number in it. When we put x in any cell, it will be the smallest number in any unprotected line in its 
intersection. Thus the goal is to put x into a cell that is an intersection of as many as possible protected 
lines. However, since we have a complete herringbone arrangement of a smaller cube matrix, any free cell 
has at most one protected line in its intersection. The cells that have one protected line are precisely the 
cells that lie in the lines that intersect a face of the existing herringbone arrangement. Consider now all 
the lines that intersect one face. After placing the first element in any of these lines, there always exists a 
cell that is an intersection of at least two protected lines. Thus, once started, one must stay with the same 
face to ensure larger elements in the smalls list. Notice, that the cells that are being filled are exactly a 
(k — l)-dimensional projection of a face of a herringbone arrangement, that is a (k — l)-dimensional matrix. 
Thus by induction hypothesis it is filled with a herringbone arrangement. 

The question that remains is which one of the faces should one start with. Notice, that one of the 
properties of the herringbone arrangement is that at any point the size of the available faces differs by at 
most 1 in any dimension, and they can differ in at most one dimension. Suppose we have one face F± of size 
t\ X • • • X ti X • • • X tk and another face F2 of size t\ X • • • X U + 1 X • • • X ifc. It is easy to see that the smalls 
sequence of the Fi face agrees with the initial segment of the smalls sequence of the F 2 face, given they are 
filled with the same numbers. The next element of the smalls sequence of the F2 face appears there exactly 
k — 2 times. However, after filling the F\ face we must start a new face, and the next (same) element in the 
sequence would appear there k — 1 times, thus in this case we get a smaller element in the smalls sequence. 
Therefore, to maximize the smalls sequence we must first fill the larger volume face projections. 

The above arguments produce, by Definition ^, a herringbone arrangement. □ 

We are now ready to give a lower bound on the spread in a completely filled cube. 
Theorem 1. The spread in a completely filled cube is at least 
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Proof. By Lemma herringbone arrangement of a completely filled cube maximizes the smalls sequence. 
A process similar to the derivation of the bounding smalls sequence creates a bounding bigs sequence. For 
the bigs sequence, however, we start instead with the largest element in the cell with the largest coordinate 
value and work our way downward. 

Since for any arrangement of the elements in the matrix, we know the bounding sequences Oj and bj, the 
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spread for any arrangement is at least max.j{bj — aj}. The closed formula for aj is unusably complicated. 
However, consider the case of j — kt k ^ 1 for some t. In this case aj is the minimum in the first line after 
filling a subcube with sides of size t, that is aj = t k = (j/k)*=*. Thus LO'AO^J 

is a crude overestimate of 

any aj (rounding up to the closest t k ) that coincides with aj in infinitely many values. The sequence bj is 
complementary of aj. There are /cn fe_1 lines in a fc-dimensional cube, therefore there are fcn' c_1 elements in 
the smalls and bigs sequences, therefore the index complimentary to j in the sequence is kn k ^ 1 — j + 1 and 

bj = n k -I- a knk -i_, J+l > n k - 1 - [((kn^ 1 -j + l)/k)^\. 

Since the sequences bj and aj are complimentary and aj is convex, then bj is concave and maxj{bj — aj} is 
achieved in the middle of the sequence, that is, when j = kn k ~ 1 /2. 

max{6j-Oj} > b kn h-i/ 2 - a kn k-i/ 2 




Note, that this lower bound is weak. It is not sufficient to merely find the maximum difference between 
the ordered minima and maxima sequences. There are more constraints that apply to the matching up of 
the sequences that can give a higher lower bound. We will discuss some of them later. 

The algorithm. 

Herringbone arrangements and any symmetric combinations of smalls and bigs herringbone arrangements 
are monotonia The idea of the algorithm is to put the two complimentary herringbone arrangements 
together, without increasing the spread. Consider all the ways of merging the two arrangements in a cube. 
Assuming that the smalls arrangement starts at the (0,0, ...,0) corner, and the bigs arrangement starts at 
the (n — 1, ...,n — 1) corner, the possibilities are defined by the order of the coordinates in building each 
arrangement. Thus there are k\ possibilities. First, assume for now that we can literally merge the two 
herringbone arrangements by putting two numbers in every cell of the matrix. In every line the smallest 
number will be taken from the smalls herringbone arrangement and the largest-from the bigs arrangement. 
Consider any line in the cube and the corresponding smallest and largest numbers that are defined by the 
merging permutation. Similar to an earlier argument, the maximum difference between the smallest and the 
largest numbers in a line occurs in the middle lines, that is the lines of the type (|~(n — 1)/2~|, *, [(n — 
1)/2J), we shall call it Pr p if p is the non-fixed coordinate. Thus to find the best permutation we calculate 
the following: 

min max {H B ma , x (Pr p ) - HB mln (Pr p )} = min max {n fc - 1 - (_ff_B min (Pr 7r (p)) + //_B min (Pr p ))} 

= n k - 1 - max min {-H r _B min (Pr^( p )) + HB min (Pr p )} 

TT^Perm 

= n k - 1 - (//B min (Pn) + HB min (Pr k )) (1) 



To see why equation [j] is true let's look at the smallest number in Pr p of the herringbone arrangement as 
a function of p. We shall show the calculations for odd n. The algebra for even n is similar, and the result 
is the same. 

/ TL — 1 71 — 1\ 

HB mia (Pr p ) = HB __,...,(),...,— — , where is in coordinate p 

+ l\ fe 1 f n — 1\ ( n + l\ k 2 f n — 1 \ /n+l x " 
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Figure 8: The minimum in line p of the Herringbone arrangement as a function of p, shown here for n = 11 
and k = 5. 
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n + 1\ P ffn + l\ k ~ p \ ln-l\ //n + l XP_1 



2 / 7 V 2 

n + 1 \ k ( n — 1 \ ( n + 1 x p ' 



1 + — — — ^- -1 



This function is exponential in p, with a negative coefficient, thus it is minimal at p = k (see Figure |§|). The 
minimum is so small relative to the rest of the function, that HB(Pr k ) + HB(Pri) < HB(Pr p ) + HB(Pr q ) 
for any i and p,q k, since even 

(HB(Pr k ) + HB(Pn)) - {HB{Pr k . x ) + HB{Pr k ^)) = - + 2 (^) - 1 < °- 

Thus for any permutation it, 

min {HB min (Pr^, p) ) + HB min (Pr p )} = min{ HB min (Pr k ) + HB mia (Pr„/ k )), 

l<p<k 

HB min {Pr k ) + HB min (P r7r - 1{k) )} 7 

and the maximum over all permutations n is 

HB min {Pn) + HB min {Pr k ). 

This means that one of the best permutations is the reverse permutation, and the spread achieved by merging 
the minima and the maxima sequences using the reverse ordering of the coordinates is 

n + 1 



n k - 1 - (HB mhl (Pri) + HB min (Pr k )) = n k - 1 - n 

when n is odd. When n is even, the middle lines are of the type ...,*, ■■■,i k ) where all the coordinates 
equal [(n — 1)/2J or \(n — 1)/2~|. Since the arrangement for the maxima sequence uses the reverse order of 
the coordinates, 

HB max (ii, *, ...,ik) =n k -1- HB mia (n - i k - 1, *, ...,n- i\ - 1). 
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Thus the maximum difference occurs in lines with the first half of the coordinates being |~(n — 1)/2] (ignoring 
the *), and the last half of the coordinates being [(n — 1)/2J . (If k is even, then if * is in the first half of the 
coordinate values, there are more floors than ceilings, and if * is in the last half, then there are more ceilings 
than floors). Thus the lower bound on the spread is 
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If n is even, this equals to 



r(fc-i)/2i 



r(fc-i)/2i 



L(fc-1)/2J 



n - I- (ii£s min (U, — - — , — - — J + HtS min (-, — - — , — - — ,Ujj - 



L(fe-1)/2J \(k-l)/2] 



r(k-i)/2i L(fc-i)/2j 



n 



--(© m t ((1) + 



* fn-2 



E 

i=l 



n - 2 



+ 1 + 



r*_ii_i 

I fc + l I II 2 A 

(|) LtJ+1 E (© + ') 



n - 2 



E 

i=0 



n - 2 



n fe - 1 



t I / n 



+ 2\ (^) L ^ J -1 



2 ; (nM)-l 



L i±ij +1 (n±_)| — I _ i ( n - 2 \ A m L_3 ~ J -1 



(2) (2±2)-l 

_ x _ ^n^r^l ^n + 2\ ( [n + 2 



n-2\ fn^ (f)^ 2 ^ -1 
(f)-l 



+ 



2(f) L^. 



(f)-l 



-1 + 



(?)(?) 



-1 + 



(?) 



- 1 



n — 2\ f fn\ Lt^J 



(I) 



- 1 



fc-i 
n\ ~2~ 



When k is odd, this simplifies to 
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and when k is even, this simplifies to 
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a b 

Figure 9: The pattern created by the algorithm in (a) two and (b) three dimensions. The shaded part is 
filled with the herringbone arrangement for minima sequence, the other half is filled with the arrangement 
for maxima sequence. 



We have shown that the merging of the two Herringbone arrangements, the minima and the maxima, 
gives the spread of: 



-l-n((2±i) fe *-!), if n is odd, 



n fe +n-2-(§) 2 (n + l)(2±2) 2 _ 2 \ if n i s even, and /c is odd, 



k-2 



fe +n-2-(f) 2 (H±2) n(^±2) 2 -1 , if both n and k are even. 



However, we cannot exactly merge the two Herringbone arrangements. We now present an algorithm that 
combines the two arrangements and preserves the spread calculated for the merging. Since the lower bound 
and the merging bound coincide for the two dimensional matrices, the algorithm is optimal for that case. In 
general, however, it is not optimal and just one of the possible generalizations of the two-dimensional case. 

Algorithm HERRINGBONE: 

1. Fill the initial diagonal half of the matrix (ii, ife), - =1 ij < \k 1J ^-\ up to and including the bisecting 
hyperplane perpendicular to the main diagonal with the herringbone arrangement for the minima 
sequence. 

2. Fill the rest of the matrix with the herringbone arrangement for the maxima sequence, skipping the 
cells already filled. 

Theorem 2. HERRINGBONE produces an arrangement of a k-dimensional cube with dimensions of 
size n with the spread of 

n fc - 1-n if n is odd, 

n k +n-2- (f)^ ((n+ 1) - 2^ , if n is even, and k is odd, 

n k + n - 2 - (§) ^ (n ^ - 1^ , if both n and k are even. 

Proof. We shall assume for simplicity that n is odd. For even n the argument works in a similar way. We 
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Figure 10: Dividing 3-dimcnsional matrix into 8 pieces. Thick lines show the parts where the border values 
come from the Herringbone arrangement for the minima sequence. 



can divide the matrix into 2 k pieces by cutting through the middle of each face, including the middle line into 
both sides that are separated by it. For k = 3 see Figure E^. The initial and the last pieces, coordinate-wise, 
are entirely within the minima sequence and the maxima sequence arrangements, respectively. Now each 
line lies in two of the 2 k pieces. The central lines go through the initial and the last pieces. The spread in 
those lines is exactly the maximum difference between the minima and maxima Herringbone arrangements, 
as calculated above. We will show that the spread in any other line does not exceed that. 
There are three types of lines that are not central lines: 

(a) lines that do not cross the bisecting plane, 

(b) lines that cross the bisecting plane and the endpoints are neither in the first or the last quadrant of 
the cube, 

(c) lines that cross the bisecting plane and one of the endpoints is either in the first or the last quadrant 
of the cube. 

If a line does not cross the bisecting plane, then either its minimum is in the first quadrant or its maximum 
is in the last quadrant, since only the first and the last quadrants do not have the bisecting plane cutting 
through them. Without loss of generality, let the line lie completely in the minima arrangement half, and 
its minimum be in the first quadrant. Then the line's minimum is at most [n/2\ k away from the parallel 
central line's minimum, while it's maximum is at least [(n/2) k \ - [n/2\ k away from a central maximum. 
Thus the spread in the line is not greater than the spread in a central line. 

The minimum in a line of type (b) is not in the first quadrant, therefore one of the coordinates if the 
minimum is greater than [n/2]. As we have mentioned, Herringbone arrangement is a fully monotonic 
arrangement, the values increasing in the direction of increasing coordinates. Therefore the line's minimum 
is greater than the minimum in the parallel central line. Similarly, the line's maximum is less than the 
maximum in the parallel central line. Thus the difference between the line's maximum and minimum, the 
spread, is less than that in the parallel central line. 

We will now consider a line of type (c). Without loss of generality we assume that the line's minimum is 
in the first quadrant. Thus the maximum is not in the last quadrant, since all the fixed coordinates of the 
points on the line are less than \n/2~\. Due to the full monotonicity of the Herringbone arrangement, both 
the minimum and the maximum in the line are less than those in the parallel central line. We will show that 
the difference between the central and the line's minimum is at least the difference between the maxima, 
thus making the spread in the line at most that in the central line. Moreover, we show that this is true for 
two lines of type (c) that differ in only one coordinate by 1, and the spread in the line closer to the central 
is at least the spread in the other line. Let at and at+i be the minima in these lines, and b t , bt+i be the 
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maxima, t < [n/2\. 
cube. Then 



Let Corner(k,t) be the number of cells cut off the corner of size t of a /c-dimensional 



ot+i-ot < (t + l) k -t k , 



and 



b t +i ~b t > (n - t) k - Corner (k, ( [|J - (t + 1)) fc) - ((n - (i + l)) fc - Corner (fc, ( - i)) fc) ) 
= (n - t) k - (n - t - l) k - (Corner (k, - i - l) fc) - Corner (fc, - tj kj^j 



Notice that 



Comerik^) ^J2J2---J2 ik -^= [l. j 

il=l 12 ik-l 



Therefore 



b t +i -b t > (n - t) k - (n - 



t _ i)k _^\-t)k-k + k-i^_^\-t)k + k-iyj 



= (n-t) k -(n-t-l) k 



(L|j-i)fc-l\_/(L|J-i + l)fc-l 



Thus 



- bt) - (ot+i - a*) > (n-t) fc -(n-t-l) fe - ((^2 J fc ^ 
= ((n-i) fe -(n-i-l) fe )-((i + l) fe -i fe )- 



((*+!)* 



(Lfj-t + i)fc-r 
(LiJ - *) fc - 1\ _ /(LiJ - * + 1) fc 

k \ k 



t < 



, therefore ((n - t) k - (n - t - l) fe ) - ((t + l) k - t k ) > 



(Lf J -t) k - i\ /(Lf J - * + 1) k- i\ therefore _ p j - 1 + 1) * - 1> ; () 



Thus 



(6 t +i - h) - (a t +i - a t ) > 
and the maximum in a non-central line is further from a central maximum than the minimum in a non-central 
line from a central minimum. Therefore the spread in a line of type (c) is not greater than the spread in a 
central line. 

We have shown that the maximum spread is achieved in the center and is as calculated above. □ 

So for a completely filled fc-dimensional cube the spread is between the lower bound LB and the upper 
bound UB, where 



LB = n — 1 - 



kn k ~ x + 2 
2k 



l \ fc- 



and 



rr 



l-«((f) M -l), 
UB= n k +n-2- (§)^ ((„+l)(s£2) 



71' 



+ n-2-(f)^(^) „ (2} 2)t-_i 



2k 

if n is odd, 

if n is even, and k is odd, 
if both n and k are even. 
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This means that in a multiple descriptions system with all channels of equal capacity the distortion in 
case of one channel failure is between LB and UB. We address the case of more than one channel failing in 
Section |2~2. 



2.2 Completely Filled Cube: Arbitrary Number of Channels Failing 



In the previous section we have obtained the distortion in a multiple descriptions system with equal capacity 
channels for the case of one channel failing. We now consider the possibility of more than one channel 
failing. That is, we are concerned with the distortions £>/c+i through D 2 k_ 2 in the rate-distortion tuples 
(log n, logn; 0, D\, D^, -Dfc+i, D 2 k_ 2 ). I n t ne number arrangement domain, we are concerned with 
designing an arrangement that minimizes the spread in any slice of any dimension. 

Notice, however, that the herringbone arrangement maximizes and minimizes the smalls and bigs se- 
quences, respectively, for any slice. Thus we can use the same construction for the algorithm. 

The maximum error guaranteed by the algorithm in case of I channel failures is 



1 



i 
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i 



L(k-o/2j rc*— o/2i 

which if n is odd, equals 
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r(fc-z)/2i 
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and if n is even, equals 



n k + n - 2 



71 + 1 



k-l 



- 1 



(n + 1)' + (to - 1)' 
2 l 




2.3 The Infinite Diagonal: 



11; 



oo, l<2<A;,m = oo 



We now would like to explore the achievable rate-distortion tuples of the type (log to, log to, log to, 0, D\, D 2 
when the original information source is quantized into m < n k integers, where log to is channel rate. This 
means that in the corresponding matrix the m numbers do not fill the entire matrix. Vaishampayan [p6[ , 

, (27j designed a solution for this case with two channels which is an arrangement of the numbers into a 
uniform diagonal. In the next section we examine this solution. However, to avoid the boundary effects, we 
will first consider the "infinite" diagonal in this section. We consider an arrangement of numbers in a infinite 
fc-dimensional diagonal of thickness I, that is, any line in the diagonal has exactly I elements in it. This case 
is also equivalent to deriving the achievable rate-distortion tuples for an unbounded discrete information 
source and fc channels of rate I . 

Again, we will concentrate on the domain of number arrangement. We derive the lower bound on the 
spread in this case in a similar manner we did in Section 2.1 for the case of a complete cube. We use the 
herringbone arrangement again to maximize the smalls sequence and to minimize the bigs sequence. Since 
the smalls and the bigs sequence arrangements can start at any point in the diagonal, we will consider 
the difference between the sequences relative to the starting points. The lower bound on the spread is 
the maximum over all lines of the difference between the smallest largest number and the largest smallest 
nummber. However, in this case this difference turns out to be constant. 

Definition 3. A herringbone arrangement of a fc-dimensional infinite Z-diagonal is defined inductively 
as follows. Assign an arbitrary order to the coordinates of the system (ii, *2j •••;**)• A herringbone arrange- 
ment of fc-dimensional 0-diagonal is empty. A herringbone arrangement of a 0-dimensional diagonal is any 
arrangement of one number in a cell. 
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Figure 11: Uniform infinite diagonal herringbone arrangements in two and three dimensions. 



Given a herringbone arrangement of the fc-dimensional diagonal up to coordinate ti in dimension i, we 
define a larger herringbone arrangement inductively: 

• project the existing arrangement onto the (k — l)-dimensional hyperplanes (*, *,U, *, *), limited 
to the diagonal, 

• calculate the volume of each projection, 

• recursively fill the largest volume projection (using coordinate order to break ties) with the herringbone 
arrangement for k — 1 dimensions. 

We denote the element in the cell {i\, ik) of the fc-dimensional herringbone arrangement by HBk(i\, ik)- 
Examples of a herringbone arrangement of a diagonal are shown in Figure 

Lemma 3. The herringbone arrangement of values in a k- dimensional diagonal maximizes the smalls 
sequence - the ascending list of the smallest numbers in a line - for that matrix. The proof is similar to 
the proof of Lemma 0. 

Corollary 1. If the smallest number in line (ii, ik) of the herringbone arrangement is dj, then 

the smallest number in line (i\ + 1, *, ik + 1) is 

fc-i ( aj + k(l/2) , if I is even, 

^ I , (z-i) fc +G+i)* fl • 

i=o ^ a 3 + i t-fl? — , if I is odd. 

Similarly, 

Corollary 2. If the largest number in line (ii, *, i^) of the herringbone arrangement is bj, then the 
largest number in line (i\ + 1, *, ik + 1) is 

fc-l f bj + k(l/2) k ~ 1 , if I is even, 



b.+Y^vi/mi/^- 1 - 1 



bj + (l - 1)k + (l+1)k , if I is odd. 



Thus, combining the results of Corollary [l] and Corollary ||, the difference bj — aj remains constant along 
any diagonal. That is, the difference between the largest and the smallest numbers in line (i±, ii, *, ik) 
equals that of line {i\ + s, ii + s, *, ik + s) for some integer s. To see this, notice that while we start 
the smalls arrangement from at some point, since the diagonal is infinite, we can continue the arrangement 
in the other direction using increasingly smaller numbers. Similarly with the bigs arrangement, we can 
continue it in the direction of the increasing of coordinates using larger numbers. Thus the smalls and 
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Figure 12: Possibly an optimal arrangement for for an incompletely filled cube. 



the bigs arrangements are the same arrangements, offset by a certain value. This arrangements are also 
"facing" opposite directions: the herringbone arrangement can be viewed as cones stacked into each other, 
and in case of the smalls sequence the "cones" face the direction of the coordinate decrease, while in the 
bigs sequence "cones" face the coordinate increase direction. However, the brims of these cones from both 
sequences coincide, and since that is where the smallest and the largest numbers in each line occur, the 
difference along any diagonal remains constant. 

A consequence of the structure of the herringbone arrangement is the fact that the difference is maximized 
over the central diagonal. That is, if (t,t, is a cell in the center of the diagonal, then the maximum 
difference is achieved for any line (t + s, t + s, *, t + s), where s is some integer, and equals to the 
difference 

HB(t + [l/2\ ,*,...,*)- HB(t - \l/2] , t, t) = 
fe-i 

i=0 



2.4 The Incomplete Cube: ni = n, 1 < i < k; m < n k < oo 

Suppose we have an arbitrary quantity of m < n k numbers to be arranged in a n x • • • x n fc-dimensional 
cube. This corresponds to the information source being quantized into m integers, where logm is less than 
the combined channel rates. At first glance, the diagonal arrangement gives the least distortion. That is 
precisely the shape used by Vaishampayan in p6| ], p5[ , p7| ]. We show, however, that diagonal arrangement 
is not the best possible and a lower distortion is possible for these rates. 

Consider a diagonal arrangement limited to the n k cube. It is a restriction of an infinite diagonal, thus 
the bound on the spread is the same over the true diagonal part of the arrangement, away from the boundary 
effect. However, the boundary parts of the arrangemen t ar e complete cubes of size [l/2\ k , and the spread 



there is the spread in a complete cube derived in Section 2T. By comparing the two spreads, in the boundary 



cubic parts and in the diagonal part, we can show that the spread on the diagonal is always greater. Thus the 
spread is dominated by the diagonal part, as long there is a true diagonal part. That is, if I < n, then there 
is at least one complete line in each dimension which belongs entirely to the diagonal, and the spread in this 
line dominates the overall spread in the matrix. But this means that we can increase the size of the initial 
cubic part, decrease the width of the diagonal part, thus decreasing the overall spread. Not only that, but 
we can decrease the spread even more by introducing non-overlapping cubic parts along the diagonal, thus, 
by balancing the entire structure, making all of the cubic part smaller. This construction i sdemonstrated in 



Figure 2.4. The spread in this arrangement is better than the diagonal. However currently we do not have 
a proof whether this arrangement is optimal or not. 

Now, if I > n, then the initial cubic parts of the diagonal overlap. Remembering from Section [2.l| , the 
maximum spread of the entirely filled cube is the spread in line (\(n — l)/2], *, [(n — 1)/2J), which 
is a line in the intersection of the first-quadrant cube and the last-quadrant cube. Those are precisely the 
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cubic parts of the diagonally filled cube. Since the spread of a cube optimally filled with m < n k numbers 
is at most the spread of the cube filled with n k numbers, in the case of the overlapping cubic parts of the 
diagonal the spread is the the same as in a completely filled cube. However, once again, this proves only the 
upper bound on the optimal arrangement, not the lower bound. 

2.5 Unequal Channel Rates 

There are currently no known existing results for the case of unequal channel rates, that is, unequal rij's. Our 
approach would provide the first non-trivial lower and upper bounds. Before the final calculations can be 
made, however, we need to generalize the concept of the integer bisecting hyperplane to non-cubic matrices. 
In 1965 Bresenham || gave an algorithm that approximates real lines on a discrete grid. Since our algorithm 
for the matrix arrangement uses two Herringbone arrangements put together at a bisecting hyperplane, we 
need to find an appropriate generalization of Bresenham's algorithm to describe that hyperplane for a matrix 
with unequal dimension sizes. 

3 Conclusions 

We have studied the problem of multiple description scalar quantizers. We have considered the question 
of describing the achievable rate-distortion tuples. The problem has been formulated as a combinatorial 
optimization problem of arranging numbers in a matrix. It has been noted that this formulation is equivalent 
to a graph theory problem of finding minimal bandwidth of cartesian products of cliques. 

We have proposed a technique for deriving lower bounds on the distortion at given channel rates. The 
approach is constructive thus allowing an algorithm that gives a fairly tight upper bound. For the case of 
two communication channels with equal rates the bounds coincide thus giving the precise lowest achievable 
distortion at fixed rates. To the best of our knowledge, this is the first result concerning the system with 
more than two communication channels. 
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